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FOREWORD 

Personalized  medicine  is  a  future  paradigm  of  healthcare  that  can  offer  right  treatment  to  the  patient  at  the  right  time  to 
achieve  safer  and  more  effective  treatment  of  diseases  [1].  Identified  as  one  of  the  Grand  Challenges  for  Engineering  in  the 
21®*  century  by  the  National  Academy  of  Engineering  [2],  it  is  a  goal  that  today’s  biomedical  engineering  community  strives  to 
fulfill  in  order  to  make  ground-breaking  changes  to  current  medical  services  offered  as  “one  size  fits  all,”  such  as  titration  of 
opioid  for  pain  that  is  guided  by  expert  opinion  and  experience  [3]  and  vasopressor  therapy  titrated  to  mean  arterial  pressure 
greater  than  a  fixed  threshold  value  [4], 

Systems  biology  can  play  a  crucial  role  in  expediting  the  paradigm  shift  from  current  reactive  medicine  to  predictive  and 
preventative  medicine  for  disease  diagnostics  and  therapy  [5].  Considering  that  today’s  personalized  medicine  still  relies 
heavily  on  manual  drug  titration  (e.g.,  pain  medicine  [3]  and  vasopressor  [4])  and  population-based  therapeutic  index/drug 
levels  (e.g.,  cancer  [6],  [7]),  and  also  as  evidenced  by  recent  initiatives  arising  in  academia  (e.g.,  [8]),  technological  leap  in 
systems  biology  including  pharmacogenomics,  pharmacokinetics,  pharmacodynamics  etc.  can  catalyze  fundamental  changes 
in  the  next-generation  healthcare,  by  predicting  the  risk  of  disease  development  in  an  individual  and  providing  personalized 
treatment  recommendations  such  as  automated  drug  selection  and  dose  adjustments. 

The  fact  that  mathematical  models  are  a  vital  component  of  systems  biology  highlights  the  significance  of  the  inverse  problem. 
The  inverse  problem  is  a  gateway  to  unveil  the  nature  of  a  biological  system  from  the  understanding  (e.g.,  through 
observations)  of  the  overall  behavior  of  the  system.  As  such,  it  plays  a  crucial  role  in  (i)  testing  the  relevance  and  validity  of  a 
mathematical  model  proposed  for  a  biological  system/process  by  fitting  the  model  to  observations,  and  also  in  (ii)  actually 
benefiting  the  personalized  treatments  of  combat  casualties  and  civilians  with  wounds  and/or  diseases  by  individualizing  the 
validated  mathematical  model  (i.e.,  adapting  the  model  to  each  individual).  Therefore,  the  ability  to  solve  the  inverse  problems 
for  mathematical  models  used  in  the  systems  biology  study  (e.g.,  mechanistic  models)  can  potentially  enhance  our 
understanding  of  complex  biological  processes  (by  testing  the  relevance  of  a  range  of  empirical  and  mechanistic  models)  and 
also  contribute  to  the  real-world  healthcare  through  personalizing  medicine  and  therapy. 

Traditionally,  an  inverse  problem  has  been  formulated  so  that  an  assumed  mathematical  model  is  fitted  to  an  input-output  data 
pair  observed  from  the  target  biological  system/process.  However,  there  are  situations  where  the  availability  of  input-output 
observations  is  limited.  In  particular,  there  is  a  class  of  biological  processes  in  which  only  the  outputs  can  be  observed  but  not 
the  input(s).  For  instance,  in  cancer  chemotherapy,  the  effect  of  anti-cancer  drug  on  tumor  growth  can  be  understood  by 
identifying  an  input-output  relationship  (or  model)  between  the  drug  concentration  and  the  resulting  tumor  size.  However, 
taking  drug  concentration  measurements  directly  in  the  tumor  cells  during  the  therapy  is  extremely  difficult  [9].  Other  drug 
therapies,  including  pain  medicine,  vasopressors  and  type  2  diabetes  mellitus,  basically  suffer  from  the  same  problem.  Even 
in  cell  biology,  variability  and  uncertainty  in  cellular  responses  to  an  identical  excitation  at  the  culture  fluid  level  are  inevitably 
regarded  as  random  noise  and  abandoned  from  subsequent  analysis,  largely  because  they  cannot  be  interpreted  in  the 
absence  of  a  measure  indicative  of  the  actual  excitation  acting  on  the  cells.  It  is  obvious  that,  due  to  the  absence  of  input 
observations,  the  standard  inverse  problem  framework  is  not  applicable  to  this  class  of  systems  and  processes.  Considering 
a  wide  range  of  real-world  clinical  applications  associated  with  this  class  of  biological  processes  (as  listed  above),  developing 
novel  methods  and  approaches  to  solve  inverse  problems  for  these  systems  can  make  enormous  impacts  on  (i)  advancing  the 
scientific  state-of-the-art  as  well  as  on  (ii)  expediting  the  developments  in  personalized  medicine. 

The  goal  of  the  proposed  project  is  to  develop  and  test  the  feasibility  of  a  novel  approach  to  solve  the  inverse  problem  for  a 
class  of  systems  arising  from  systems  biology  study,  in  which  input  is  unknown  (e.g.  cannot  be  observed)  but  multiple  outputs 
can  be  observed.  As  mentioned  above,  the  most  significant  challenge  associated  with  this  class  of  inverse  problems  is  that 
the  standard  approach  to  inverse  problem  (where  the  parameters  of  the  mechanistic  model  are  optimized  to  fit  the  input-output 
data)  is  not  applicable  in  the  absence  of  system  input  observation.  To  resolve  this  challenge,  this  project  proposes  to  exploit 
the  commonality  shared  by  the  outputs  that  originate  from  the  same  input.  Indeed,  noting  that  these  outputs  originate  from  the 
identical  input,  a  relationship  between  these  outputs  can  be  formulated,  which  can  subsequently  be  utilized  in  solving  the 
inverse  problem  without  necessitating  the  input  observations. 
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1.  PROBLEM  STATEMENT 

In  this  project,  a  generic  mechanistic  model  in  which  each  input-output  relationship  is  given  by  a  cascade  connection  of  a 
linear  dynamic  system,  a  static  nonlinear  function  and  an  indirect  response  mechanism  is  considered.  Consider  Figure  1,  in 
which  the  input  to  the  system  is  unknown  but  multiple  outputs  from  the  system  can  be  observed.  In  particular,  this  project 
considers  systems  with  two  output  observations,  which  results  in  the  most  challenging  inverse  problem  of  this  kind.  The 
system  is  described  by  a  class  of  mechanistic  model  called  the  indirect  response  model,  used  widely  in  systems  biology  at 
multiple  different  scales  from  cell  signaling  and  receptor  theory  to  quantitative  pharmacology.  In  Figure  1 ,  u  is  the  input,  Rj  is 

the  j-th  response  (output),  fji(xj,  0ji)  and  fjo(xj,  0jo)  are  the  saturating  nonlinear  functions  representing  stimulation  and/or 
inhibition  effects  of  the  input,  kj;  and  are  the  rate  constants  for  production  and  loss  of  the  response,  and  tj  is  the  time 
constant  associated  with  the  distribution  of  the  input  to  the  site(s)  of  action: 

Rj  =  Rjifji(^j' ®ji)  ~  Rjofjo(Xj<  0jo)Rj  j  =  1  2  (1) 

TjXj  =  — Xj  -F  u 

In  this  class  of  models,  the  input  u  is  delayed  by  the  latency  model  tjXj  =  -xj  -F  u  to  produce  xj .  From  the  traditional 
pharmacological  perspective,  u  and  xj  can  be  regarded  as  the  concentration  of  a  medication  agent  in  the  blood  and  at  the  site 
of  action,  respectively,  xj  is  then  translated  to  the  stimulation  and/or  inhibition  effects  acting  upon  the  production  (through 
fii(xj,  0ji))  and  dissipation  (through  fjo(xj,  0jo))  of  the  response  Rj.  The  resulting  response  Rj  is  then  elicited  by  the  model 
Rj  =  kjifji(xj,  0ji)  -  kjofjo(xj,0jo)Rj.  This  class  of  mechanistic  models  has  been  widely  used  in  systems  biology  and 
pharmacology  [10,  11],  including  mechanistic  modeling  studies  in  cancer  chemotherapy  (e.g.,  [12,  13]),  anti-diabetic  drugs 
(e.g.,[14])  and  HIV  (e.g.,  [15]). 


Figure  1 :  Systems  biology  process  described  by  a  class  of  mechanistic  models.  Two  outputs  are  available  as  observations  but 
input  observation  is  not  available.  In  this  project,  the  inverse  problem  for  this  class  of  biological  systems  will  be  solved  by 
exploiting  the  commonality  shared  by  the  output  observations  in  the  absence  of  input  observations. 
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2.  SUMMARY  OF  THE  MOST  IMPORTANT  RESULTS 

The  goal  of  this  project  is  to  develop  a  novel  approach  to  solve  inverse  problems  for  a  class  of  systems  biology  models  with 
unknown  inputs,  and  test  the  validity  and  feasibility  of  the  approach.  The  specific  aims  of  the  proposed  project  are  to  (i) 
develop  a  systematic  inverse  modeling  procedure  and  (ii)  to  assess  its  preliminary  feasibility  with  numerical  example(s). 


2.1.  High-Level  Overview 

In  this  project,  we  achieve  the  above  specific  aims  as  follows.  Based  on  the  model  shown  in  Figure  1 ,  we  consider  3  problems 
having  increasing  complexities:  (i)  steady-state  dose-response  problem  (Figure  2a),  (ii)  indirect  dose-response  problem  with 
immediate  dose  effect  (Figure  2b),  and  (iii)  indirect  dose-response  problem  with  latency  in  dose  effect  (Figure  2c).  For  each  of 
these  inverse  problems,  we  first  study  the  solvability  of  the  problem  in  terms  of  the  identifiability  of  model  parameters.  We 
elucidate  the  best  extent  to  which  the  model  parameters  can  be  identified  from  two  output  observations,  as  well  as  the 
circumstance(s)  under  which  this  can  be  achieved.  We  then  establish  a  step-by-step  procedure  to  identify  the  model. 
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Figure  2:  The  class  of  inverse  problem  pursued  in  this  project,  (a)  Steady-state  dose-response  problem,  (b)  Indirect  dose- 
response  problem  with  immediate  dose  effect,  (c)  Indirect  dose-response  problem  with  latency  in  dose  effect. 


2.2.  Steady-State  Dose-Response  Probiem 

The  steady-state  dose-response  problem  is  obtained  by  eliminating  all  the  dynamic  (i.e.,  time  derivative)  terms  from  Eq.  (1): 

kjifji(xj,  0ji)  —  kjofjo(xj,  0jo)Rj 


Xj  =  U 


j  =  l,2 


(2) 


In  the  systems  biology  models,  the  simulation  and  inhibition  effects  are  often  given  by  the  following  saturation  function: 


f„(x|,e|,)  =  i  +  -5fi^,  =  i  +  1  =  1.2  p) 


aji  +  Xj 


Ojo  -F  Xj 


where  0ji  =  (oji,  bji|  and  0jo  =  (ajo,  bjo).  It  is  obvious  that  the  “+”  sign  represents  stimulation  while  the  sign  represents 
inhibition.  Besides,  we  assume  that  the  initial  values  of  the  outputs  Rj(t  =  0)  before  the  application  of  the  input  (i.e.,  u  =  0 
for  t  <  0),  are  available.  Since  fji(xj,  0ji)  =  fjo(xj,  0jo)  =  1  if  u  =  0,  we  have: 

Rji  ~  RjoRj<  j  ~  i<2  (4) 

Combining  Eq.  (2)-(4)  results  in  the  following  relation  between  Xj  and  Rj: 


1  -F 


bjiXj 


aji  -F  Xj 


Rj(0)  = 


1  -F- 


bjoXj 


ajo  -F  Xjj 


Ri(t),  j  =  1,2 


(5) 


Most  often,  the  stimulation/inhibition  effect  acts  only  upon  production  (i.e.,  to  kjj)  or  dissipation  (i.e.,  to  kjo).  In  case  the  effect 
acts  upon  production,  Eq.  (5)  reduces  to: 
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bjiXj 


1  +  ■ 


aji  +  x,j 

whereas  in  case  the  effect  acts  upon  dissipation: 


Rj(0)  =  Rj(t),  j  =  1,2 


Ri(0)  = 


1  +  ■ 


bjoXj 


ajo  +Xjj 


Rj(t),  j  =  1,2 


Therefore,  any  steady-state  dose-response  can  be  represented  by  the  following  unified  relation: 


yj(t) 


1  -h 


bjXj 


aj  +  Xjj 


j  =  l,2 


(6a) 


(6b) 


(7) 


where  yj(t)  =  Rj(t)/Rj(0)  if  stimulation/inhibition  effect  acts  upon  production,  and  yj(t)  =  Rj(0)/Rj(t)  if  the  effect  acts 
upon  dissipation.  Then,  the  inverse  problem  for  steady-state  dose-response  problem  reduces  to  solving  the  following  relation 
foraj  and  bj,  j  =  1,2: 

Yi  -  1  y2  -  1 


±bi  -h  1  -  yi  ±b2  -h  1  -  yz 


(8) 


2.2.1.  Identifiability  Analysis 

For  the  steady-state  dose-response  problem  in  Eq.  (8),  we  make  the  following  claim  on  the  identifiability: 


CLAIM  1:  Identifiability  of  Steady-State  Dose-Response  Model 


Consider  the  steady-state  dose-response  model  in  Eq.  (8).  Based  on  two  output  observations  yj(t),  j  =  1,2,  the  following 
parameters  can  be  identified: 


^2 


(9) 


PROOF  1:  See  Appendix  1 . 


Several  physical  insights  can  be  obtained  from  CLAIM  1.  First,  the  individual  parameter  values  cannot  be  identified  just  by 
solving  Eq.  (8).  This  can  also  be  understood  by  reformulating  Eq.  (8)  as  follows: 


1 

Yi  -  1 


=  Ai 


1 

y2  - 1 


+  ^2 


(10) 


So,  the  two  parameters  and  Az  are  sufficient  to  specify  the  relation  between  y^  -  1  and  yz  -  1.  In  many  real-world 
problems,  however,  full  effects  are  typically  assumed  for  fji(xj,  0ji)  and  fjo(xj,  0jo)  (so  that  b^  =  1  and/or  b2  =  1).  In  this 
regard,  3  practically  useful  scenarios  can  be  conceived: 


1)  bj  =  1,  j  =  1,2:  In  this  case,  Eq.  (9)  returns  a  unique  value  of  ai/a2  (see  the  discussion  below). 

2)  bj  =  p,  j  =  1  or  j  =  2:  In  this  case,  Eq.  (9)  returns  a  unique  values  of  ai/a2  and  bj  ^  p. 

3)  bi  =  ab2,  a  known  a  priori:  In  this  case,  Eq.  (9)  returns  a  unique  values  of  ai/a2  and  bj,  j  =  1,2. 

Second,  aj,  j  =  1,2  cannot  be  uniquely  determined  just  by  solving  Eq.  (8).  This  indeed  makes  sense,  since  by  the  problem 
formulation  the  input  to  the  system  u  is  unknown.  In  fact,  an  important  consequence  of  input  being  unknown  is  that  its  scale  is 
also  unknown.  To  illustrate,  suppose  the  input  was  doubled  in  the  steady-state  dose-response  model  shown  in  Eq.  (7)  (i.e.. 
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Xj  ^  2xj).  It  is  possible  to  keep  yj(t)  consistent  simply  by  doubling  aj.  This  recognition  indicates  that  the  absolute  values  of 
Oj  cannot  be  identified  based  on  Eq.  (8);  rather,  only  the  ratio  between  and  a2,  ai/a2,  can  be  identified. 


2.2.2.  Inverse  Problem  Solution  Procedure 

Given  Rj(t),  t  =  1,  ••• ,  N  and  j  =  1,2,  the  steady-state  dose-response  problem  can  be  solved  by  the  following  procedure: 


1) 

2) 


Form  yj(t)  =  Rj(t)/Rj(0),j  =  1,2. 

Form  Eq.  (10)  and  formulate  into  a  least-squares  problem  to  identify  and  A2: 

II  1  1 

=  arg  min^ 


f^iAz) 


Yi  -  1  Yz  -  1 


2.3.  Indirect  Dose-Response  Problem  with  Immediate  Dose  Effect 

The  indirect  dose-response  problem  with  immediate  dose  effect  is  obtained  by  eliminating  the  latency  model  tjXj  =  -xj  +  u 
from  Eq.  (1): 


Rj  ~  ^jifji(^j<  ®ji)  kjofjo(xj)  0jo)f^j 


Xj  =  U 


j  =  l,2 


(11) 


It  is  assumed  that  1)  the  saturation  function  in  Eq.  (3)  is  used  to  represent  the  simulation  and  inhibition  effects,  and  that  2)  the 
stimulation/inhibition  effect  acts  only  upon  production  or  dissipation.  In  contrast  to  the  steady-state  dose-response  problem  in 
which  the  inverse  problem  reduces  to  the  unified  relation  in  Eq.  (8)  regardless  of  how  the  stimulation/inhibition  effect  acts  upon 
the  biological  system  (i.e.,  whether  it  acts  upon  production  or  dissipation),  the  indirect  dose-response  problem  yields  three 
relations  depending  on  the  nature  of  the  stimulation/inhibition  effect  as  follows. 

1 )  If  both  indirect  response  outputs  Ri  (t)  and  R2  (t)  are  subject  to  stimulation/dissipation  effect  acting  upon  production, 
each  indirect  response  model  reduces  to  the  following: 


Rj  ~  kjifji(u,  0ji)  kjoRj<  j  ~  1<2 


(12a) 


2)  If  both  indirect  response  outputs  R^  (t)  and  R2  (t)  are  subject  to  stimulation/dissipation  effect  acting  upon  dissipation, 
each  indirect  response  model  reduces  to  the  following: 


Rj  —  kji  kjofjo(u,  0jo)Rj,  j  —  1,2 


(12b) 


3)  If  one  indirect  response  output  (say  Ri(t))  is  subject  to  stimulation/dissipation  effect  acting  upon  production  while 
the  other  (say  R2(t))  is  subject  to  stimulation/dissipation  effect  acting  upon  dissipation,  the  indirect  response  model 
reduces  to  the  following: 


Ri  —  k]^jfij(u,  0]^j)  kj^oR]^,  R2  ~  ^21  02o)R2 

Firstly,  consider  Eq.  (12a).  Using  Eq.  (3)-(4),  Eq.  (12a)  reduces  to 


fji(U'0ji)  =  1  ± 


bjU 

Oj  -F  u 


Rj/kjo  +  Rj 


R 


jo 


'JO 


j  =  l,2 


where  yj  =  Rj/Rjo-  So,  solving  Eq.  (13)  for  u  yields: 

^j/kjo  ”F  2j 


U  =  Oi 


ibj  Zj/kjQ  Zj 


j  =  l,2 


(12c) 


(13) 


(14) 


where  Zj  =  yj  -  1.  In  sum,  the  inverse  problem  for  indirect  dose-response  problem  with  immediate  dose  effect  acting  upon 
production  reduces  to  solving  the  following  relation  for  Oj,  bj  and  kjo,  j  =  1,2: 
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Zi/kio  +  Zi  Z2/k2o  +  Z2 

+bi  —  z^/k^o  ~  +b2  —  ^2/^20  ~  Z2 


Secondly,  consider  Eq.  (12b).  Using  Eq.  (3)-(4),  Eq.  (12b)  reduces  to 


fjo(u,  0jo)  =  1  ± 


bjU 

Oj  +  u 


kjo-yj 

kjoYi 


where  yj  =  Rj/Rjo-  So,  solving  Eq.  (16)  for  u  yields: 

Zj/kjo  d"  Zj 


U  =  — Oi 


j  =  l,2 


j  =  l,2 


(16) 


(17) 


'zj/kjo  +  Zj±bj(l  +  Zj)' 

where  zj  =  yj  -  1.  In  sum,  the  inverse  problem  for  indirect  dose-response  problem  with  immediate  dose  effect  acting  upon 
dissipation  reduces  to  solving  the  following  relation  for  aj,  bj  and  kj^,  j  =  1,2: 

ZlAio  +  Zi  Z2/k2o  +  Z2 


Zi/kio  -h  zi  ±  bi (1  -h  zi)  Z2/k2o  -h  Z2  ±  b2 (1  -h  Z2) 


(18) 


Thirdly,  consider  Eq.  (12c).  Using  Eq.  (3)-(4),  Eq.  (14)  and  Eq.  (17),  Eq.  (12c)  reduces  to 

Zi/kio  +  Zi  Z2/k2o  +  Z2 

u  =  ai  — - 7- - ,  u  =  —an  — n - 7 — 7 - r  (10) 

±bi  -  Zi/kio  -  Zi  Z2/k2o  -h  Z2  ±  b2(l  -h  Z2) 

In  sum,  the  inverse  problem  for  indirect  dose-response  problem  with  immediate  dose  effect  acting  upon  production  (Ri(t)) 
and  dissipation  (R2(t))  reduces  to  solving  the  following  relation  for  aj,  bj  and  kj^,  j  =  1,2: 

ZlAio  +  Zi  Z2/k2o  +  Z2 


^  ±bi  -  Zi/kio  -  zi 


—  a-o 


±2/^20  +  Z2  ±b2(l  -h  Z2) 


(20) 


2.3.1.  Identifiability  Analysis 

For  each  of  the  three  relations  presented  in  Eq.  (12),  we  make  the  following  claims  on  the  identifiability: 


CLAIM  2:  Identifiability  of  Indirect  Dose-Response  Model  with  Immediate  Dose  Effect  in  Eq.  (15) 


Consider  the  indirect  dose-response  model  with  immediate  dose  effect  in  Eq.  (12a).  Based  on  two  output  observations  Zj(t), 
j  =  1,2,  the  following  parameters  can  be  identified: 


azbi 


^20 


(21) 


PROOF  2:  See  Appendix  2. 


CLAIM  3:  Identifiability  of  Indirect  Dose-Response  Model  with  Immediate  Dose  Effect  in  Eq.  (18) 


Consider  the  indirect  dose-response  model  with  immediate  dose  effect  in  Eq.  (12b).  Based  on  two  output  observations  Zj(t), 
j  =  1,2,  the  following  parameters  can  be  identified: 


^1^2 

azbi 


•"20 


(22) 


PROOF  3:  See  Appendix  3. 
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CLAIM  4:  Identifiability  of  Indirect  Dose-Response  Model  with  Immediate  Dose  Effect  in  Eq.  (20) 


Consider  the  indirect  dose-response  model  with  immediate  dose  effect  in  Eq.  (12c).  Based  on  two  output  observations  yj(t), 
j  =  1,2,  the  following  parameters  can  be  identified: 


^20 


(23) 


PROOF  4:  See  Appendix  4. 


It  is  noted  that  the  models  in  Eq.  (15),  Eq.  (18)  and  Eq.  (20)  above  can  be  cast  into  a  unified  model  of  the  following  form: 


1  1 
=  +  ^2 


gl(t)  ^g2(t) 


(24) 


where  gj(t),  j  =  1,2  is  given  by 


1 

iT  +  'i 


in  case  of  Eq.  (15),  whereas  gj(t),  j  =  1,2  is  given  by 


1  Z,  Z| 


kjo  Zj  -F  1  Zj  -F  1 

in  case  of  Eq.  (18).  Accordingly,  in  case  of  Eq.  (20),  gj(t),  j  =  1,2  is  given  by 

1  z. 


g,(.)  =  -  +  z.,  g, (,)  =  -(__  +  _) 


(25a) 


(25b) 


(25c) 


It  can  be  shown  that,  using  Eq.  (24),  equivalent  linear  regression  models  for  Eq.  (15),  Eq.  (18)  and  Eq.  (20)  that  contain  A2, 
kio  and  k2o  as  unknown  parameters  can  be  obtained.  For  example,  for  Eq.  (15),  the  following  linear  regression  model  can 
be  derived  from  Eq.  (24)  and  Eq.  (25a): 


Z2 


1  Ai 

-  — Z2  +r— Zi  +A1Z1  -F 
^20  Klo 


^10^20 


Z1Z2  +  : 


Z1Z2  + 


Z^Z2  “F  A7  Z.]  z 


2  ^1^2 


'"lo 


•"20 


(26) 


which  clearly  illustrates  that  the  unknowns  listed  in  Eq.  (21)  can  be  readily  identified. 


2.3.2.  Inverse  Problem  Solution  Procedure 


Given  Rj(t),  t  =  1,  ••• ,  N  and  j  =  1,2,  the  indirect  dose-response  problem  with  immediate  dose  effect  can  be  solved  by  the 
following  procedure: 


1)  Formyj(t)  =  Rj(t)/Rj(0),j  =  l,2. 

2)  Using  the  steady-state  dose-response  data,  form  Eq.  (10)  and  formulate  into  a  least-squares  problem  to  identify 
and  A2: 

1  1 


{Ai,An  =  arg  min 


-Ai; 


-A, 


lyi  -  1  y2  -  1 

3)  Using  the  transient  (or  alternatively,  all  the)  dose-response  data,  formulate  Eq.  (24)  into  a  least-squares  problem  to 
identify  k^o  and  k2o: 

1  1 
gi(t::k]_o)  g2(lik2o) 


{kIo<k2o}  =  arg  min 
(kio.kzoj 


where  gj(t),  j  =  1,2  is  given  by  Eq.  (25). 
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2.4.  Indirect  Dose-Response  Problem  with  Latency  in  Dose  Effect 

The  indirect  dose-response  problem  with  latency  in  dose  effect  concerns  Eq.  (1).  It  is  assumed  that  1)  the  saturation  function 
in  Eq.  (3)  is  used  to  represent  the  simulation  and  inhibition  effects,  and  that  2)  the  stimulation/inhibition  effect  acts  only  upon 
production  or  dissipation.  Similarly  to  the  indirect  dose-response  response  problem  with  immediate  dose  effect,  this  problem 
yields  three  relations  depending  on  the  nature  of  the  stimulation/inhibition  effect  as  follows. 

1 )  If  both  indirect  response  outputs  Ri  (t)  and  R2  (t)  are  subject  to  stimulation/dissipation  effect  acting  upon  production, 
each  indirect  response  model  reduces  to  the  following: 


Rj  —  kjjfji^Xj,  0ji)  kjof^j 
TjXj  =  — Xj  -I-  U 


j  =  l,2 


(27a) 


2)  If  both  indirect  response  outputs  R^  (t)  and  R2  (t)  are  subject  to  stimulation/dissipation  effect  acting  upon  dissipation, 
each  indirect  response  model  reduces  to  the  following: 


TjXj  =  — Xj  +  U 


j  =  l,2 


(27b) 


3)  If  one  indirect  response  output  (say  Ri(t))  is  subject  to  stimulation/dissipation  effect  acting  upon  production  while 
the  other  (say  R2(t))  is  subject  to  stimulation/dissipation  effect  acting  upon  dissipation,  the  indirect  response  model 
reduces  to  the  following: 


—  klifli(Xl<  01i)  kloRl<  ^2  —  1^21  k2of2o(X2<  ^20)^2 


TjXj  =  — Xj  +  U 


j  =  l,2 


(27c) 


Firstly,  consider  Eq.  (27a).  Defining  Zj  =  yj  -  1,  yj  =  Rj/Rjo  and  fji(xj,  0ji)  =  1  ±bjXj/[aj  -I-  Xj]  =  1  -I-  gji(xj,  0ji), 
the  indirect  dose-response  model  Rj  =  kjifji(xj,  0ji)  -  kj^Rj  reduces  to  the  following: 


Zj  =kjo[gji(xj,0ji)-Zj],  j  =  1,2 


(28) 


Then,  Xj  can  be  expressed  in  terms  of  Zj  as  follows: 

ajgji(xj,0ji) 


= 


k^  +  Zj 

.^jo 


±b,-g|,(x,,9„)  +u_[iL+2 

“  '  Lkjo  ' 


j  =  l,2 


(29) 


2 

Therefore,  it  is  possible  to  denote  gji(xj,  0ji)  =  gji(zj,kjo).  Then,  since  Xj  =  ajbjgji(zj,kjo)/[±bj  -  gji(zj,kjo)]  ,  the 
latency  model  can  be  rewritten  as  follows: 


Tjajbjg  (zj,kjo)  ajgji(zj<kjo) 


=  u,  j  =  1,2 


(30) 


In  sum,  the  inverse  problem  for  indirect  dose-response  problem  with  latency  in  dose  effect  acting  upon  production  reduces  to 
solving  the  following  relation  for  aj,  bj,  kj^  and  Tj,  j  =  1,2: 


Tiaibig  j(zi,kio)  aig  j(zi,kio)  T2a2b2g2i(z2,  k2o)  ,  a2g2i(z2,k2o) 


+ 


-!-■ 


[±bi  -g^j(Zi,kij]^  ±’^1  gli(Zl<kio)  [±b2  -g2i(Z2,k2o)]^  -*^2  g2i(Z2<k2o) 


(31) 


where 


gji(zj<kjo)  =  j^  +  Zj<  gji(zj,kjo)  =  j^  +  Zj 


(32) 


HO 


HO 
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Secondly,  consider  Eq.  (27b).  Defining  zj  and  yj  as  above  and  fjo(xj,  0jo)  =  1  ±bjXj/[aj  +  xj]  =  1  +  gjo(xj,  0jo),  the 
indirect  dose-response  model  Rj  =  kjj  -  kjofjo(xj,  0jo)Rj  reduces  to  the  following: 

=  kjo  [gjo(xj<  0jo)yj  -  Zj]  <  j  =  1<2  (33) 

Then,  xj  can  be  expressed  in  terms  of  Zj  as  follows: 


= 


k^+^i 

^jo 


^jo 


+•^1  gjo(^j'®jo)  -t-bjYj  -  I^  +  Zj  -l-bj(zj -I- 1)  -  I^+Zj 


j  =  l,2 


(34) 


Therefore,  it  is  possible  to  denote  gjo(xj,0jo)  =  gjo(zj,kjo).  Then,  since  xj  =  ajbjgjo(zj,kjo)/[±bj  -  gjo(zj,kjo)]^ 
the  latency  model  can  be  rewritten  as  follows: 

Tjajbjgjo(zj,kj„)  ajgj^(zj,kj„) 


=  u,  j  =  1,2 


(35) 


In  sum,  the  inverse  problem  for  indirect  dose-response  problem  with  latency  in  dose  effect  acting  upon  dissipation  reduces  to 
solving  the  following  relation  for  aj,  bj,  kj^  and  tj,  j  =  1,2: 


Tiaibig_(zi, 

bio) 


+  = 


aigio(zi,kio) 


T2a2b2g2o(Z2,  ^2o) 


-h  — 


a2g2o(Z2,k2o) 


[+bl  -gio(Zl,kio)]  +*^1  glo(Zl<bio)  [-hb2  -g2o(Z2,k2o)]  +*^2  g2o(22<k2o) 


where 


•2 


Zj-l-kjoZj  ■  r  ,  ^  Zj(zj -I- 1) -I- kjoZj  Zj 
gio(zj'kjo)  = -^77-— T,  gj„(zj,kjo}  = -- 


kjo(zj  +  l) 


bjo(zj  +  l) 


(36) 


(37) 


Thirdly,  consider  Eq.  (27c).  Using  Eq.  (30)  and  Eq.  (35),  Eq.  (27c)  reduces  to 

'r2a2b2g2o(z2<  b2o)  a2g2o^z:2,  k2o) 


^  _  Tiaibig^j(zi,kio)  ^  aig^j (zi,  ki,,) 


u  = 


H-: 


[±bi  -  g^j(Zi,kio)]^  ±’^1  gli(Zl,klo)  [+b2  -  g2o(Z2,k2o)]^  g2o(Z2,k2o) 


(38) 


In  sum,  the  inverse  problem  for  indirect  dose-response  problem  with  immediate  dose  effect  acting  upon  production  (Ri(t)) 
and  dissipation  (R2(t))  reduces  to  solving  the  following  relation  for  aj,  bj  and  kjo,  j  =  1,2: 

Tiaibigj^j(zi,  kio)  aigii(zi,  kio)  T2a2b2g2  (z2,k2o)  a2g2o^z:2,  k2o) 

+  ^ ^  ^  ^  (39) 


where 


[±bi  -g^j(Zi,kio)]^  ±t>l  gli(Zl,klo)  [-|-b2  -g2o(Z2,k2o)]^  ■'■’^2  g2o(Z2,k2o) 


Zi  Z7  "1“  yi'po'Z'p 

gli(Zl,kio)  =  — +Zi,  = 


(40) 


2.4.1.  Identifiability  Analysis 

The  models  in  Eq.  (31),  Eq.  (36)  and  Eq.  (39)  can  be  cast  into  a  unified  model  of  the  following  form,  which  can  be  viewed  as 
an  expanded  version  of  Eq.  (24)  that  includes  the  latency  in  dose  effect: 


g2(t)  -Aigi(t) 


a-i  b2  —  g2(t) 

A2gl(t)g2(t)  = 

32  bi-gi(t) 


b2  .  bi-gi(t) 

^  g2  (t)  r  777 
bi  b2-g2(t) 


(41) 


11 


64433-MA-ll:  Solving  Inverse  Problems  for  Mechanistic  Systems  Biology  Models  with  Unknown  Inputs  (HAHN,  Jin-Oh) 

where  gj(t),  j  =  1,2  is  given  by  Eq.  (25a)  for  Eq.  (31),  Eq.  (25b)  for  Eq.  (36),  and  Eq.  (25c)  for  Eq.  (39).  Noting  thatgj(t) 
can  be  written  as  the  following  unified  form: 

Wj 

gj(t)  =  j— +  Vi  (42) 

^jO 

where  Wj  and  Vj  can  be  constructed  from  measurements  (and  thus  can  be  regarded  as  known),  the  identifiability  of  the 
indirect  dose-response  problem  with  latency  in  dose  effect  can  be  analyzed  by  investigating  the  identifiability  property  of  Eq. 
(41).  We  make  the  following  claim  on  the  identifiability. 


CLAIM  5:  Identifiability  of  Indirect  Dose-Response  Model  with  Latency  in  Dose  Effect 

Consider  the  indirect  dose-response  model  with  latency  in  dose  effect  in  Eq.  (41).  Based  on  two  output  observations  yj(t), 
j  =  1,2,  the  following  parameters  can  be  identified: 

Ti,  T2,  kio,  k20,  bi,  b2,  —  (43) 

^2 

PROOF  5:  See  Appendix  5. 


2.4.2.  Inverse  Problem  Solution  Procedure 


Given  Rj(t),  t  =  1,  ••• ,  N  and  j  =  1,2,  the  indirect  dose-response  problem  with  immediate  dose  effect  can  be  solved  by  the 
following  procedure: 

1)  Formyj(t)  =  Rj(t)/Rj(0),j  =  l,2. 

2)  Using  the  steady-state  dose-response  data,  form  Eq.  (10)  and  formulate  into  a  least-squares  problem  to  identify 
and  A2: 

n*  .*-1  .  II  1  1 

{Ai,A2}  =  arg  min^ 


{AiAz} 


Yi 


1  ^^2 


-A- 


3)  Using  the  transient  (or  alternatively,  all  the)  dose-response  data,  formulate  Eq.  (41)  into  a  least-squares  problem  to 
identify  Ti,  T2,  kio,  k2o,  bi,  b2  and  01/02: 


mm 


g2(t)  -^igi(t)  -^2gi(t)g2(t)  -Ti^gi(t) 


b. 


g2(t)  ,  b,  . 

■  +  T2T-g2(t) 


2.  ..bi-gi(t) 


where  gj(t),  j  =  1,2  is  given  by  Eq.  (42). 


bi-gi(t)  bi' 


g2(t) 
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3.  BENCHMARK  EXAMPLES 


The  efficacy  of  the  proposed  inverse  modeling  approach  is  demonstrated  using  3  benchmark  examples:  bronchodilator,  anti¬ 
cancer  drug  and  vasopressor. 


3.1.  Terbutaline  Dose-Response  Modeling  [16] 

Terbutaline  is  a  fast-acting  bronchodilator,  which  is  often  used  as  short-term  treatment  aid  for  asthma.  In  a  previous  study,  a 
pharmacological  model  dictating  the  effect  of  plasma  concentration  of  terbutaline  on  the  changes  in  glucose,  insulin  and 
potassium  concentrations  in  healthy  adults  was  developed.  In  this  project,  this  model  was  adopted  as  a  benchmark  problem 
where  the  relations  between  the  plasma  concentration  of  terbutaline  versus  glucose  and  potassium  concentrations  were 
derived  from  the  measurements  of  glucose  and  potassium.  The  model  relating  the  plasma  concentration  of  terbutaline  (x)  to 
glucose  (Ri)  is  given  by: 

Ri  =  kii  (l  +  -^)  -  kio(l  +  F(I))Ri  (44) 

where  F(I)  is  a  known  function  of  insulin  concentration  I,  while  the  model  relating  the  plasma  concentration  of  terbutaline  to 
potassium  is  given  by: 

(  b2X  \ 

^2  =  1^21  —  k2o  ( 1  +  -  — — )  R2  (45) 

So,  the  problem  reduces  to  an  indirect  dose-response  problem  with  immediate  dose  effect.  The  plasma  concentration  of 
terbutaline  x  was  generated  by  using  a  pharmacokinetic  model,  which  was  derived  by  fitting  a  two-compartment  model  to  the 
data  reported  in  a  previous  study  [16].  A  set  of  escalating  infusion  rates  was  used  to  produce  response  data  employed  in 
solving  the  inverse  problem  (see  Figure  3  for  the  time  courses  of  terbutaline  infusion  rate,  terbutaline  plasma  concentration, 
glucose  concentration  and  potassium  concentration).  The  “true”  parameter  values  used  in  the  simulation  are  summarized  in 
Table  1. 


Figure  3:  Time  courses  of  terbutaline  infusion  rate,  glucose  concentration  and  potassium  concentration. 
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Table  1:  Parameter  values  used  in  terbutaline  dose-response  modeling  and  the  corresponding  estimates. 


Xi 

^2 

kio 

kzo 

True  Values 

1.3263 

0.0995 

0.0724 

0.0324 

Estimates 

1.3263+/-0.0000 

0.0995+/-0.0000 

0.0724+/-0.0000 

0.0324+/-0.0000 

The  inverse  problem  was  solved  using  a  MATLAB’s  numerical  optimization  function  to  yield  the  estimates  of  the  parameters  in 
Table  1.  In  solving  the  problem,  a  set  of  20  random  initial  guesses  for  the  parameters  (within  +/-30  %  of  each  of  the  true 
parameter  values  in  Table  1)  was  used  to  assess  the  robustness  of  the  proposed  inverse  modeling  approach.  The  resulting 
distributions  of  the  estimates  are  summarized  in  Table  1. 


3.2.  Anti-Cancer  Drug  Dose-Response  Modeling 


cMet  and  hepatocyte  growth  factor  (HGF)  have  been  implicated  in  the  development  and  progression  of  multiple  human 
cancers  and  are  attractive  targets  for  cancer  therapy.  PF02341066  is  a  compound  that  was  shown  to  be  effective  in  inhibiting 
cMet  phosphorylation  and  signal  transduction  as  well  as  cMet-dependent  proliferation,  migration  or  invasion  of  human  tumor 
cells,  and  also  exhibits  anti-angiogenic  properties  [17].  In  a  previous  study,  a  pharmacological  model  that  relates  the  plasma 
concentration  of  PF02341066  to  cMet  phosphorylation  in  tumor  and  tumor  volume  was  developed  [12].  In  this  project,  this 
model  was  used  as  a  benchmark  problem  where  the  pharmacological  relations  between  the  plasma  concentration  of 
PF02341066  versus  cMet  phosphorylation  and  tumor  volume  were  derived  from  their  measurements.  The  model  relating  the 
effect  site  concentration  of  PF02341066  (yi)  to  cMet  phosphorylation  is  given  by: 


R,  =  k.,(l-U^) 

a, +v,/ 


kioRi 


ai  +  yi 

while  the  model  relating  the  plasma  concentration  of  PF02341066  (x)  to  tumor  volume  is  given  by: 

(b2/(k2i  -k2o))x 


^2  —  k2i  3  _|.  x)  k2oR2  —  (k2i  k2o) 


1  - 


a,  -h  X 


(46) 


(47) 


So,  the  problem  reduces  to  an  indirect  dose-response  problem  with  latency  in  dose  effect  in  R^  and  immediate  dose  effect  in 
R2.  The  plasma  concentration  of  PF02341066xwas  generated  by  using  a  pharmacokinetic  model,  which  was  derived  by 
fitting  a  single  compartment  model  with  first-order  absorption  to  the  data  reported  in  a  previous  study  [12].  A  set  of  impulse 
doses  was  used  to  produce  response  data  employed  in  solving  the  inverse  problem  (see  Figure  4  for  the  time  courses  of 
PF02341066  dose,  PF02341066  plasma  concentration,  cMet  phosphorylation  and  tumor  volume).  The  “true”  parameter 
values  used  in  the  simulation  are  summarized  in  Table  2. 
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10  20 
Time  [h] 


Figure  4:  Time  courses  of  PF02341066  dose,  cMet  phosphorylation  and  tumor  volume. 


Table  2:  Parameter  values  used  in  PF02341066  dose-response  modeling  and  the  corresponding  estimates. 


bi 

b2 

kio 

1^20 

True  Values 

1 

2.070 

20 

0.0063 

7.353 

11.514 

Estimates 

1.0000+/-0.0000 

2.0710+/-0.0001 

20.019+/-0.0013 

0.0063+/-0.0000 

7.3672+/-0.0002 

11.5176+/-.0004 

The  inverse  problem  was  solved  using  a  MATLAB’s  numerical  optimization  function  to  yield  the  estimates  of  the  parameters  in 
Table  2.  In  solving  the  problem,  a  set  of  20  random  initial  guesses  for  the  parameters  (within  +/-30  %  of  each  of  the  true 
parameter  values  in  Table  2)  was  used  to  assess  the  robustness  of  the  proposed  inverse  modeling  approach.  The  resulting 
distributions  of  the  estimates  are  summarized  in  Table  2. 


3.3.  Frusemide  Dose-Response  Modeling 

The  pharmacodynamics  of  frusemide  in  terms  of  diuresis  and  natriuresis  can  be  modeled  by  indirect  response  model  [18].  In 
this  project,  a  modified  version  of  this  model  was  used  as  a  benchmark  problem  where  the  pharmacological  relations  between 
the  plasma  concentration  of  frusemide  versus  its  diuretic  and  natriuretic  effects  were  derived  from  their  measurements.  The 
model  relating  the  effect  site  excretion  rate  of  frusemide  (yi)  to  diuresis  is  given  by: 
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Ri  =  kii-kio(l--^)Ri 

V  ai  +  yj 

while  the  model  relating  the  effect  site  excretion  rate  of  frusemide  (y2)  to  natriuresis  is  given  by: 

Rz  =  kz,-k2„(l-;^)Rz  (49) 

So,  the  problem  reduces  to  an  indirect  dose-response  problem  with  latency  in  dose  effects.  The  urinary  excretion  rate  of 
frusemide  x  was  generated  by  using  a  pharmacokinetic  model,  which  was  derived  by  fitting  a  three-compartment  model  to  the 
data  reported  in  a  previous  study  [18].  A  set  of  escalating  infusion  rates  superimposed  by  a  sequence  of  uniform  random 
numbers  was  used  to  produce  response  data  employed  in  solving  the  inverse  problem  (see  Figure  5  for  the  time  courses  of 
frusemide  infusion  rate,  frusemide  urinary  excretion  rate,  diuresis  and  natriuresis).  The  “true”  parameter  values  used  in  the 
simulation  are  summarized  in  Table  3. 


200 


150 


c 

E 


100 


a. 

O 


50 


Figure  5:  Time  courses  of  frusemide  infusion  rate,  diuresis  and  natriuresis. 


Table  3:  Parameter  values  used  in  flusemide  dose-response  modeling  and  the  corresponding  estimates:  mean  (SD). 


bi 

b2 

kio 

k2o 

Tl 

T2 

32/21 

True  Values 

0.9100 

0.9600 

74 

260 

0.4762 

0.0989 

0.3649 

Estimates 

0.9089+/- 

0.0021 

0.9596+/- 

0.0007 

72.7886+/- 

1.3256 

261.2992+/- 

6.6937 

0.4881+/- 

0.0106 

0.1026+/- 

0.0025 

0.3621+/- 

0.0006 

The  inverse  problem  was  solved  using  a  MATLAB’s  numerical  optimization  function  to  yield  the  estimates  of  the  parameters  in 
Table  3.  In  solving  the  problem,  a  set  of  20  random  initial  guesses  for  the  parameters  (within  +/-30  %  of  each  of  the  true 
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parameter  values  in  Table  3)  was  used  to  assess  the  robustness  of  the  proposed  inverse  modeling  approach.  The  resulting 
distributions  of  the  estimates  are  summarized  in  Table  3. 
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4.  Conclusions 

This  study  proposed  and  demonstrated  the  feasibility  of  deriving  data-driven  model  of  a  class  of  mechanistic  biological  system 
models  from  output  responses  alone.  Mathematical  analysis  was  performed  to  elucidate  the  identifiability  property  of  the 
approach,  which  was  then  validated  with  benchmark  numerical  examples.  In  sum,  the  approach  proposed  in  this  study  (called 
the  “endpoint  information  fusion”)  can  be  very  useful  in  deriving  data-driven  models  of  a  class  of  mechanistic  biological  system 
models,  which  is  potentially  applicable  to  wide-ranging  systems  biology  investigations. 

This  study  leaves  room  for  open  challenges  that  need  to  be  rigorously  addressed  in  the  follow-up  studies.  First,  this  study 
showed  that  filtered  white  noise  is  effective  in  deriving  high-fidelity  data-based  models  (especially  the  parameters  in  the  model 
responsible  for  dynamic  responses,  i.e.,  effect  compartment  time  constant).  However,  no  systematic  analysis  was  performed 
in  this  study  to  understand  how  to  select/optimize  dynamic  inputs  required  to  derive  high-fidelity  data-based  models.  Future 
studies  to  address  this  issue  need  to  be  conducted.  Second,  this  study  showed  the  feasibility  of  batch  inverse  modeling 
based  on  the  endpoint  information  fusion  approach.  In  reality,  however,  the  underlying  biology  varies  as  the  system  profile 
varies.  Future  studies  on  recursive  inverse  modeling  based  on  the  endpoint  information  fusion  approach  are  thus  warranted. 
Third,  this  study  examined  the  endpoint  information  fusion  approach  via  simulation  to  establish  its  initial  proof-of-principle.  To 
make  a  strong  claim  on  its  efficacy,  follow-up  work  on  experimental  validation  of  the  approach  must  be  conducted. 
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APPENDIXES 


Appendix  1.  Proof  of  Claim  1:  Identifiability  of  Steady-State  Dose-Response  Model 

Starting  from  Eq.  (8)  we  write: 


a  -a 

±bi  +  1  -  Yi  ±b2  +  1  -  Yz 

(A.1) 

Inverting  both  sides  we  have: 

1  ±bi  +  1  -  Yi  _  1  ±b2  +  1  -  Y2 

3i  Yi  - 1  32  Y2  - 1 

(A.2) 

Next  multiplying  both  sides  by  e 

ii  we  may  write: 

±bi  _  ai  ±b2  1  /  ai\ 

Yi-l  a2Y2-l  ^  32/ 

(A.3) 

And  then  we  divide  by  ±bi: 

1  ^  a^  b2  1  /I  1  \  Si 

Yi-1  a2biY2-l  W  32/ bi 

(A.4) 

Finally,  by  denoting 

and  =  ^2  we  arrive  at  the  linear  parametric  model: 

Y  =  4)'r0 

(A.5) 

in  which  the  regressor  vector  is  defined  as: 

1  1 

4)=  - T  1 

Ly2  - 1 

(A.6) 

and  the  unknown  parameter  vector  is  defined  as: 

0  =  [Ai  A2r 

(A.7) 

So,  0  is  identifiable  as  long  as  informative  data  are  provided  to  solve  Eq.  (A.5). 

Appendix  2.  Proof  of  Claim  2:  Identifiability  of  Indirect  Dose-Response  Model  with  Immediate  Dose  Effect  in  Eq.  (13) 

Starting  from  Eq.  (13)  we  write: 

ai  Vkio  +  zi  _  z,/k,o  +  z, 

32  ±bl  -  ZlAio  -  Zi  ±b2  -  Z2/k20  -  Z2 

By  multiplying  both  sides  of  Eq.  (A.8)  by  the  product  of  the  denominators,  we  have: 

^(±b.,  (A  (iL  .  0  (A. 

Next,  by  expanding  Eq.  (A.9)  and  collecting  terms  of  and  Z2  and  their  derivatives,  we  have: 

t>i  _  _  Si  1  Sl  / 1  1  \  Si 

—  (+Z2)  +  bi  (+Z2)  +  -  b2  —  (±Zi)  +  —  b2  (±Zi)  +  f  - —  J  — ^  Z1Z2 

1^20  32  d2  \di  d2/  K10K20 

A.K 

/I  l\ai  /I  l\ai  /I  1\ 

+ - -  Z1Z2  + - )- - Z1Z2  + - 3iZiZ2  =  0 

Vai  ^2'  ^lo  ^3]^  32/k2o  ^2' 

Next,  we  multiply  Eq.  (A.15)  by  k2o/bi  to  achieve  the  linear  parametric  formulation: 
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_  _  ai  ^2  /I  1  \ 

(+Z2) + k2o(+z2) + + ^ir^2o(±zi)  +  (-  -  inr^i^z 

^2^1  Kio  32  01  Vai  82/ KioDi 

A.11 

/I  l\ai  /I  l\ai  /I  l\ai 

By  using  =  aib2/a2bi  and  A2  =  ( —  -  — )  we  may  write: 

Va^  ^2/  bi 

_  ^2  k2n 

k2o(+Z2)  +^1  ^(±Zi)  +  Aik2o(±Zi)  +  — Z1Z2  +A2—  Z1Z2  +  A2Z1Z2  +A2k20  Z1Z2  =  ±Z2  (A.12) 

Klo 

So,  we  arrive  at  the  linear  parametric  model: 

Y  =  +Z2  =  4)'^0 

where  the  regressor  vector  is  defined  as: 

4)  =  [+Z2  ±Zi  ±Zi  Z1Z2  Z1Z2  Z1Z2  Z1Z2] 

and  the  unknown  parameter  vector  is  defined  as: 


0  = 


‘"20 


Ai  ; -  Ai  k 


•"lo 


At  k^o 

1-20  ^2  A,k 

Klo 


2-20 


(A.13) 
(A.  14) 

(A.15) 


So,  0  is  identifiable  as  long  as  informative  data  are  provided  to  solve  Eq.  (A.13).  Thus,  A^,  A2,  k^o  and  k2o  are  identifiable 
as  long  as  informative  data  are  provided  to  solve  Eq.  (A.13). 


Appendix  3.  Proof  of  Claim  3:  Identifiability  of  Indirect  Dose-Response  Model  with  Immediate  Dose  Effect  in  Eq.  (16) 


Starting  from  Eq.  (18)  we  write: 

ai  zi/kio  +  zi 


Z2/k20  +  Z2 


32  Zi/kio  +  Zi  ±  bi(l  +  Zi)  Z2/k2o  +  Z2  ±  b2(l  +  Z2) 

By  multiplying  both  sides  by  the  product  of  the  denominators  of  the  two  fractions,  we  have: 


itk 


k-^  +  lP  +  ir^+H±b2^(j^  +  ^+Zi  +  Z,Z2 

KinK2n  Kin  ^20  /  d?  nKi  n 


/  Z2  Z2Z1 

±bi  (— + +  Z2  +  Z1Z2 


‘"20  -20 


32  ^kio  kio 

) 


cL  b  X  ^  ^ 

Now  upon  expanding,  dividing  both  sides  by  b^,  and  using  A^  =  ^^andA2  =  ( - )  ^  we  may  write: 

^2^1  ^1'  bi 


Z1Z2  +  ^^ZiZ2  +  ^^ZiZ2  +  A2Z1Z2  ±  ^^(Zi  +  Z1Z2)  +  Ai(Zi  +  Z1Z2) 


kiok2o 


‘"lo 


^20 


‘"lo 


+  i—  (Z2  +  Z2Z1)  =  Z2  +  Z1Z2 
K20 

So,  we  arrive  at  the  linear  parametric  model: 

Y  =  Z2  +  Z1Z2  =  4)'^0 

where  the  regressor  vector  is  defined  as: 

4)=[ZiZ2  Z1Z2  Z1Z2  Z1Z2  ±(Zi+ZiZ2)  (Z1  +  Z1Z2)  +(Z2+Z2Zi)] 

and  the  unknown  parameter  vector  is  defined  as: 


(A.16) 


(A.17) 


(A.  18) 

(A.  19) 
(A.20) 
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A, 


0  = 


At  At  A-i  1 

iT^  ir  ir  iT, 


(A.21) 


So,  0  is  identifiable  as  long  as  informative  data  are  provided  to  solve  Eq.  (A.19).  Thus,  A^,  A2,  k^o  and  k2o  are  identifiable. 

Appendix  4.  Proof  of  Claim  4:  Identifiability  of  Indirect  Dose-Response  Model  with  Immediate  Dose  Effect  in  Eq.  (18) 

Starting  from  Eq.  (20)  we  write: 

ai  Zi/kio  +  zi  Z2/k2o  +  Z2 


32  ±bi  -  Zi/kio  -  Zi  Z2/k2o  +  Z2  ±  b2  (1  +  Z2) 

By  multiplying  both  sides  by  the  product  of  the  denominators  of  the  two  fractions,  we  have: 


0  = 


A2  A2  A2  ^  A^  ^  ^ 

kiok2o  k]_o  k2o  k]_o  k2oJ 


tT 


(A.22) 


(A.23) 


cL  b 

Next,  by  expanding  both  sides  and  using  A^  =  and  A2  =  ( - )  tT’ 

\  Z1Z2  +  j^ZiZ2  +  j^Z2Zi  +  A2Z1Z2  +  ^(±(Zi  +  Z1Z2))  +  Ai(±(Zi  +  Z1Z2))  +^(+Z2) 

K10K20  Kio  K20  Kio  K20  (A.24) 

=  +Z2 

So,  we  arrive  at  the  linear  parametric  model: 

Y  =  +Z2  =  4)'^0 

where  the  regressor  vector  is  defined  as: 

4)  =  [Z1Z2  Z1Z2  Z2Z1  Z1Z2  ±(Zi  +  ZiZ2)  ±(Zi  +  ZiZ2)  +Z2] 

and  the  unknown  parameter  vector  is  defined  as: 


(A.25) 

(A.26) 

(A.27) 


So,  0  is  identifiable  as  long  as  informative  data  are  provided  to  solve  Eq.  (A.25).  Thus,  A^,  A2,  k^g  and  k2o  are  identifiable. 


Appendix  5.  Proof  of  Claim  5:  Identifiability  of  Indirect  Dose-Response  Model  with  Latency  in  Dose  Effect 

Starting  from  (41): 

ai  Ut  — 27(0  b7  bi— ei(t) 

g2(t)  -Aigi(t)  -  A2gi(t)g2(t)  =  Ti— gi(t)- - — 7;T-T2^g2(t)r - (A.28) 

32  bi-gi(t)  bi  b2-g2(t) 

Multiplying  both  sides  by  (b^  -  gi(t))(b2  -  g2(t))  yields: 

(g2  -Aigi  -A2gig2)(bi  -gi)(b2  -gz)  =  Ti^gi(b2  -gz)^  -T2^g2(bi  -gi)2  (A.29) 

which  is  expanded  to  the  following: 

(g2  -  Aigi  -  A2gig2)(bib2  -  big2  -  b2gi  -  g2gl) 

=  Ti  — gi(bi  +  gi  -  2b2g2)  -  T2  ^g2(b?  +  g?  -  2bigi) 

32  bi 

which  can  be  rearranged  to  the  following: 
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(bib2)g2  -  bigi  -  Aibib2gi  +  (Aibi  -  b2  -  bib2A2)gig2  +  +  (^i  +  b2A2)g2g? 

+  (^2bl  -  l)glg2  +  ^2glg2 

=  ^gi(bi  +  gi  -  2b2g2)  -  T2  ^g2(bi  +  gi  -  2bigi) 

^2  "Jl 

Now  dividing  both  sides  of  (A.36)  by  T2b2bi  yields: 


^2^2'  ‘■2  ^^2^2  ^2^1 

(^2bl  1)  2  I  ^2  2  2 

+  - - glg2  +  .  u  u  glg2 


12^1  U2 


T2bib2  T2b]^b2 

Tiaib2  .  Ti  ai 
gi  + 


gigi 


T2  a2bi  T2  a2b]^b2 
Next  expanding  g^  and  g2  and  using  (42),  (A.32)  reduces  to: 


^T2a2bi®^®^ 


Wy  Vy 

- —+  — 

^2o'^2  '^2 


_  /  1  \  /w| 

Vb2T2/  Vk|o 


■  +  v|  + 


2W2V2 


'■20 


Ai  /Wi  \ 

Ty\k,^  ""V 


/  Jfl _ ^  /W1W2  W1V2 

VT2b2  T2bi  T2Akiok2o  kio 


W2V1  A  , 

-f: —  +  V1V2  j  + 


'20 


Ai  +  b2A2  /  w|w2 

I  1  1  1,0,  I 


w?v 


1V2  ^v|w2 


T2bib2  Vk?ok2o  '  k20 

^  (A2bi  ~  1)  ^  w|wi  ^  wfvi  ^  vfwi 


+  v|v2  + 


T2bi  Vk?o 

2W1V1W2  2w^V^V2 


+  v|  + 


ki„k 


+ 


10*''20 


'lo 


+ 


T2bib2  Vkiokio 

,,2,.,2  ..,2„2  n,.,2 


k 


lo 


2W1V2W2  2W2ViV2\ 

+  ^2Vi  +  -j— r - +  — r - 1 

K10K20  K20  / 


w^wf  W^vf  2w|w2V2  wfvl 

+  - 1-  ,  o  , - 1-  ^^5 - 1-  v(V2  + 


2W2v|v2  ^  Zwiwfvi  ^  Zw^v^v 


io''2o  *'10  k?„k 


T2bib2  Vkiokio  k^ 

4W1W2V1V2 


10*'20 


*'2o 


'■20 


kiokio 


+ 


<10 


+  ■ 


kink 


10*<20 


Ti  aib2 
T2  a2bi 


/Wi  .  \  Ti 
Vkio  V  T2: 


VVj^wf  W^vf  2W1W2V2  V^wf  ,  2V1W2V2 

+  ^ - 1-  ^ ^ - 1-  — I-  V1V2  + 


'2  a2bib2  Vkiokio  k 


lo 


kiok2o 


*<2o 


k 


20 


+  2- 


■( 


W1W2  W1V2  V1W2 

+  ^ - 1-  ^ - 1-  V 


T2  a2bi  \kiok20  k 


lo 


<20 


\  W2 
■iV2)+T— 
^  *<20 


(A.31) 


(A.32) 


2wiVi\ 

kio  j 


(A.33) 


+ 


1  /  W2W|  VV2V|  2VV2W1V1  V2wi  2  2V2WiVi\  2  /  W2W1  VV2V1  V2W1  \ 

b^lk  k2  ^“k — '^~k~k —  +  l^  +  ’^2Vi  +  — r - )“vrik  k  ^“k — ^  “k —  +  '^2Vij 

**1  \*<2o*<lo  *<20  *<lo*<2o  *<io  *<lo  /  **1  '*<lo*<2o  *<2o  *<lo  ' 


=  -Vi 


So,  we  arrive  at  the  linear  parametric  model: 
Further  expansion  of  (A.34)  yields: 

Where: 


Y  =  -V2  =  4>'^0 

-V2  =(t)]'0i  + 4)2  02 


(A.34) 

(A.35) 
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4)l01  =  [W2,V2,v|,Vi,Wi,V2Vl,VlV2] 


11  1 
k2oT2'T2'  b2T2' 


Tz'  T2kio'  bi'  T2a2bi. 


(A.36) 


Note  that  4)2  02  contains  all  the  other  terms  in  (A.33).  From  (A.36)  we  can  clearly  see  that  the  parameter  set  (A.37)  is  uniquely 
identifiable: 


0  = 


‘"2o< 


bi,b2,Ti,T2, 


(A.37) 
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